Beyond Vocal Tract Actions: Speech Prosody and Co-verbal Gesturing in Face-to-face Communication
نویسندگان
چکیده
A comprehensive approach for describing the functional and behavioral aspects of communicative actions, e.g. facial, manual, and vocal tract actions, has been established for face-to-face-communication (Cogn Process 11:187-205, 2010). Within the speech domain, this approach will now be extended in two ways: (i) by introducing level actions such as turn, breath group, phrase, stress group, syllable, and sound group level actions, and (ii) by distinguishing between prosodic and segmental speech actions such as respiratory, voice quality, tonal, and vocal tract actions. Moreover this paper describes how speech actions are temporally coordinated with co-verbal (or co-speech) communicative actions such as manual and facial actions.
منابع مشابه
Towards an articulation-based developmental robotics approach for word processing in face-to-face communication
Accepted ... Abstract While we are capable of modeling the shape, e.g. face, arms, etc. of humanoid robots in a nearly natural or humanlike way, it is much more di cult to generate human-like facial or body movements and human-like behavior like e.g. speaking and co-speech gesturing. In this paper it will be argued for a developmental robotics approach for learning to speak. On the basis of cur...
متن کاملSemantic Back-Pointers from Gesture
Although the natural-language processing community has dedicated much of its focus to text, faceto-face spoken language is ubiquitous, and offers the potential for breakthrough applications in domains such as meetings, lectures, and presentations. Because spontaneous spoken language is typically more disfluent and less structured than written text, it may be critical to identify features from a...
متن کاملEmotion in the voice influences the way we scan emotional faces
Previous eye-tracking studies have found that listening to emotionally-inflected utterances guides visual behavior towards an emotionally congruent face (e.g., Rigoulot and Pell, 2012). Here, we investigated in more detail whether emotional speech prosody influences how participants scan and fixate specific features of an emotional face that is congruent or incongruent with the prosody. Twenty-...
متن کاملCategorical processing of negative emotions from speech prosody
Everyday communication involves processing nonverbal emotional cues from auditory and visual stimuli. To characterize whether emotional meanings are processed with category-specificity from speech prosody and facial expressions, we employed a cross-modal priming task (the Facial Affect Decision Task; Pell, 2005a) using emotional stimuli with the same valence but that differed by emotion categor...
متن کاملAn Action-Based Concept for the Phonetic Annotation of Sign Language Gestures
Background: Communicative actions are specific movements or gestures which are accomplished by vocal tract articulators (lips, tongue, velum etc.) for speech, by facial articulators (eye brows, eye lids etc.) for co-verbal facial expression and by other bodily articulators (hands, arms etc.) for co-verbal gesturing. While action-based approaches already exist for spoken language processing it i...
متن کامل